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I. INTRODUCTION 


A. BACKGROUND 

A main objective of CIP is to reduce the cost of ownership 
of an aircraft engine currently in use by the military forces. 
Any CIP proposal needs justification. A contractor may 
formulate the justification to increase flight safety, 
increase mission effectiveness, or to decrease aircraft or 
engine operating costs. In the latter case, a contractor 
could use a justification method that compares an old engine 
component to a new component. This could come in the form of 
increased mean time between failures, less preventative or 
scheduled maintenance, or the component may be cheaper to 
repair. 

One type of justification method currently in use is the 
Cost Effectiveness Analysis (CEA) Model of the Air Force. It 
compares the Life Cycle desee besacr an existing component 
and an Engineering Change Proposal (ECP). Hopefully, 
investment of Component Improvement Program (CIP) dollars in 
Engineering Change Proposals (ECP) or Power Plant Changes 
(PPC) are justified because of “ul wate dollar savings. Future 
dollar savings are usually expressed in net present value 
terms and an estimate is made of the calendar time or flight 


hours to achieve the Return of Investment. This model is now 


beginning to be used by the contractors of the Air Force, with 
the Navy discussing its merit for their Justification process 
for ECP’s. This thesis will continue the evaluation of the 


structure of the CEA model begun by Davis. ([Ref. 1] 


B. OBJECTIVES 

The primary objectives of this thesis will focus on three 
steps which are: 

1. Conduct a literature review of Life Cycle Cost Models 
to determine what elements in a model should be considered for 
evaluation. 

2. Determine if the CEA model accurately reflects the 
life cycle costs for aircraft engine component improvements 
based on the information obtained from the literature review 
and the evaluation. If not, then suggestions will be made for 
improvements to the model. 


3. Identify the cost udr1veus sine enes ele icgeim 


C. METHODOLOGY 
The methodology for conducting this research involved a 
thorough review of current literature, instructions, reference 
materials and guidance dealing with Life Cycle Cost models. 
Secondly, a sensitivity analysis on the structure of the 
Cost Effectiveness Analysis model will be performed to 


determine what costs drive the model. Additionally, these 


cost drivers will be verified against the model description to 
validate their relevance in life cycle costing. 

Finally, simulations of component failures will be 
performed on the model by randomly generating these failures 
and incorporating them into the model, thus determining what 


effect reliability has on the model. 


D. ORGANIZATION OF THE THESIS 

Chapter II describes the format of the Cost Effectiveness 
Analysis Model and defines the input elements. 

Chapter III briefly describes typical elements of life 
cycle cost, and life cycle costing models, explains the 
sensitivity analysis performed to determine the cost drivers 
of the CEA model and details the simulation process used to 
evaluate the effect reliability plays in the model. 

Chapter IV contains a summary of the thesis, conclusions 
obtained from the analysis, and recommendations for 


improvements. 


Il THE CEA MODEL 


A. BACKGROUND OF THE MODEL 

The Cost Effectiveness Analysis Model (CEAMOD) was 
originally a spread sheet based model developed by Pratt & 
Whitney from an initial structure proposed by Larry Briskin of 
the Air Force. P&W developed a mainframe computer spread 
sheet using DYNAPLAN. The model has recently been adapted by 
General Electric for a microcomputer using LOTUS 123 software. 

The main purpose of CEAMOD is to project the savings which 
would be achieved from implementing an ECP. The military 
services can use that information to prioritize a list of 
proposed ECP’s. The projected savings are determined from the 
cost differences between implementing the proposed 
configuration and sustaining the current configuration. 
Ideally, the costs of implementing the ECP should be 
outweighed by the resultant operations and support savings 


[Refs 2-7 


B. FORMAT OF THE MODEL 

The model’s structure is comprised of three primary 
sections which contain the assumptions, data inputs, and the 
results summary. The assumption section is made up of 13 
elements which propose how and when the proposed modification 


will take place. The data input section consists of current 


and proposed parameter values, provided by the operator, which 
are used to calculate the life cycle cost differences between 
the current and proposed configurations. These parameters 
address the overall operational and support costs that are to 
be expected in any decision involving an engine change 
proposal. Finally, the results summary consists of a summary 
page and pages detailing the calculations performed to predict 
the net annual dollar savings from incorporating the ECP. A 


typical example using CEAMOD, is illustrated in Appendix A. 


C. DESCRIPTION OF INPUT PARAMETERS 1.0 THROUGH 21.0 
The input section contains 53 elements which are 
subdivided into two sections. Section one contains 21 
elements which are general data elements while section two 
provides the data elements to be used to show the comparison 
between the current configuration and the proposed 
configuration. The role of each of the elements in the model 
are described below for the first 21 elements. 
[Ref. 3] 
1.0 Incorporation style selects the method of 
incorporating the modification into the existing fleet. 
@® Attrition incorporates the modification only during a 
"failure" of the engine or old component. 
@® First Opportunity incorporates the modification during an 


engine unscheduled or scheduled event, whichever occurs 
BLLSe: 


® Forced Retrofit allows the modification to occur at a 
specific rate set by the user. 

2.0 Delta Production Cost is the difference between the 
production cost of an engine incorporating the modification 
and one that does not contain the modification. This factor 
only involves engines still under production. The delta 
production cost is provided by the contractor and is 
incorporated directly into the,results summary. 

3.0 Kit Hardware Cost is the purchase price per engine 
of the component modification kit. This cost is provided by 
the contracroern. 

4.0 Kit Labor Man-hours is the expected time in hours to 
install a modification kit and is usually broken into two 
values; one for organizational and intermediate (O&I) level 
labor hours and the other for depot labor hours. 

5.0 Labor Cost per Man-hour is determined from labor 
cost data maintained by the military organization that is 
considering the ECP. 

6.0 Tech Pubs Cost incorporates any technical 
publication costs associated with the proposed component 
change. This input is supplied by the contractor. 

7.0 TCTO Cost is a time compliance technical order cost. 
A TCTO is issued for important changes when urgency is an 
issue. The associated costs usually coincide with forced 


retrofits or first opportunity changes. 


8.0 New Part Number Intro Cost is the cost of 
introducing a new part number into the military supply system. 
An ECP may result in several new parts. 

9.0 Part Number Maintenance Cost covers the annual cost 
of maintaining a part in the military supply system. 

10.0 Tooling and Support Equipment Cost includes any 
special tooling or support equipment which would be required 
to carry out the component modification. This would include 
the cost to modify the current tooling and support equipment 
to comply with the engine change requirement. 

11.0 Test Fuel- $/Gal is the cost per gallon of fuel to 
test the engine after the modification has been installed. 

12.0 Test Fuel- Gal/Hr comes from the standard history 
file and is the number of gallons required to test the engine 
following modification. 

13.0 Spare Parts Factor is an estimate, as a percentage 
of total installed/modified engines, of the spare engines or 
spare modules which will also require the proposed 
modification. 

14.0 Year Field Modification Starts is the year that 
modifications will begin on engines which have already been. 
produced. Usually, the initial supply of the improved 
components will go into engines currently on the production 
line. Following that, field modifications will begin. These 


field modifications cannot begin until there are sufficient 


improved components available beyond the needs of engine 
ProGgucteron: 

15.0 % Scheduled Events Being Modified allows only a 
percentage of those scheduled events when a engine is eligible 
to receive the modification to actually receive the 
modification. The remaining events for that year for other 
engines receive no modifications. 

16.0 % Unscheduled Events Being Modified allows only a 
percentage of those unscheduled events when an engine is 
eligible to receive the modification to actually receive the 
modification. The remaining events for that year for other 
engines receive no modifications. 

17.0 Failure Rate Allowing Modification is the rate at 
which unscheduled opportunities occur due to an engine failure 
which would allow the modification to be installed. 

18.0 Year Production Starts is when production of engines 
incorporating the modification starts. 

19.0 Fiscal Year Dollars is the baseline year from which 
net present value will be calculated. 

20.0 TAC/EFH Ratio is the number of engine cycles 
expected per flight hours (EFH). An engine cycle is a 
measurement of the variation in thrust which an engine endures 
during operation. The formula used to measure engine cycles 
places the greatest emphasis on extreme variations in engine 
thrust and the least emphasis on constant cruise conditions. 


An engine will normally accumulate multiple cycles per sortie. 


The TAC/EFH ratio can be obtained from the engine standard 
history file by averaging the total accumulated cycles (TAC) 
over a given number of EFH. 

21.0 TOT/EFH Ratio also comes from the engine standard 
history file and is the average of total engine operating 
hours per engine flight hour. Total engine hours include test 


time and runway taxi time. 


D. DESCRIPTION OF INPUT PARAMETERS 22.0 THROUGH 53.0 

Input parameters 22.0 through 53.0 are provided in a two- 
column format and present information about the current and 
proposed engine component designs. Elements 25.0 to 37.0 
account for any variations in labor and material costs which 
might result from scheduled inspections, removals, and repairs 
between the current configuration and the proposed 
configuration. Elements 38.0 to 49.0 account for any 
variations in labor and material costs which might result from 
unscheduled inspections, removals, and repairs between the 
current and proposed configurations. 

22.0 Unscheduled Failure Rate/1000 EFH is the failure 
rate which represents how often the component being modified 
is expected to fail per EFH. This rate drives the component’s 
unscheduled events and associated costs. 

23.0 Scheduled Maintenance Intervals (TAC’s) represents 
the scheduled time interval, measured in engine cycles, 


between inspections of the engine to check for possible 


problems. A scheduled maintenance may be an opportunity to 
install the proposed modification. This interval drives the 
scheduled events and the associated costs. 

24.0 Calculated Rate/1000 EFH is not an input element. It 
is derived by taking the element no. 22 value and dividing it 
by element no. 20. The "Calculated Rate/1000 EFH" represents 
a scheduled maintenance rate factor for the engine based on 
EFH. The model’s Life Cycle Cost formulas use this rate 
factor in calculating the expected EFH between scheduled 
maintenance actions. 

25.0 Scheduled Hours to Inspect, O Level is the number of 
man-hours necessary at the O level to accomplish any scheduled 
inspection on the part to be modified. 

26.0 Scheduled *% Removed at O&I Level is the percentage 
of the total units requiring scheduled work that are removed 
at the O or I levels. If this percentage is not 100%, the 
remaining units would, by necessity, be removed at a depot or 
not removed at all. 

27.0 Scheduled Man-hours to Remove and Replace (O level) 
is the number of man-hours to perform a scheduled 
maintenance at the O level to remove and replace the component 
being modified. 

28.0 Scheduled Man-hours at I Level provides the number 
of man-hours required to accomplish any scheduled maintenance 


at the I level on the component being modified. 
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29.0 Scheduled % O&I Requiring Repair provides the 
percentage of total units which are expected to require repair 
at the O&I levels during any scheduled maintenance. 

30.0 Scheduled Repair Cost O&I Level provides the cost to 
repair one unit at either the O and I level. 

31.0 Scheduled % Returned to Depot is the percentage of 
components which require repair during scheduled maintenance 
that cannot be performed at the O&I level. 

32.0 Scheduled Man-hours Depot accounts for the total 
number of scheduled maintenance man-hours required to repair 
the component at the depot. 

33.0 Scheduled % at Depot Requiring Repair refers to the 
percentage of total components requiring scheduled repair at 
‘the depot level. 

34.0 Scheduled Material Cost (Depot) is the total 
material cost resulting from scheduled work to repair one unit 
at the depot level. 

35.0 Scheduled % Scrap is the percentage of total units, 
identified during scheduled maintenance, which must be 
scrapped (beyond economic repair). 

36.0 Hardware Cost .to Scrap represents the replacement 
cost of a component which is scrapped during scheduled 
maintenance. The assumption is that if a component is 
scrapped, then a new unit must be bought to replace the old 


One: 
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37.0 Scheduled Engine Test Time is the number of hours of 
engine test time required for each unit undergoing scheduled 
maintenance at the depot level. 

38.0 Unscheduled Man-hours to inspect, O Level refers to 
the number of man-hours at the O level which are required to 
accomplish any unscheduled inspections on the component being 
considered for modification. 

39.0 Unscheduled * Removed at O&I level is the percentage 
of total components for which unscheduled removal is able to 
be performed at the O&I levels. The rest of the unscheduled 
removals are performed at the depot level. 

40.0 Unscheduled Man-hours to Remove and Replace (0 
level) is the number of man-hours required to remove and 
replace the component at the O level in order to perform 
unscheduled maintenance. 

41.0 Unscheduled Man-hours at I Level provides the number 
of man-hours expended at the I level on the component in order 
to accomplish unscheduled maintenance. .- 

42.0 Unscheduled % O&I Level Requiring Repair provides 
the percentage of total units which were found to require 
repair at the O&I level during unscheduled maintenance. 

43.0 Unscheduled Material Cost (O&I level) provides the 
total cost to repair one unit at the O or I level. 

44.0 Unscheduled % Returned to Depot is the value of the 


percentage of components which are beyond the repair 


LZ 


capabilities of the O & I level and must be returned to the 
depot for unscheduled maintenance. 

45.0 Unscheduled Man-hours Depot accounts for the total 
number of man-hours required to perform unscheduled 
maintenance on the component at the depot. 

46.0 Unscheduled % at Depot Requiring Repair refers to 
the percentage of total components requiring unscheduled 
maintenance at the depot level. 

47.0 Unscheduled Material Cost (Depot) is the total 
material cost resulting from unscheduled maintenance to repair 
one unit at the depot level. 

48.0 Unscheduled % Scrap represents the percentage of 
total components which are expected to be identified as beyond 
economical repair during unscheduled maintenance. 

49.0 Hardware Cost to Scrap represents the replacement 
cost of the component associated with unscheduled failures. 
It has the same value as element no. 36 except in unusual 
cases. 

50.0 Unscheduled Test Time is the total engine test time 
required for each component requiring repair during 
unscheduled maintenance. 

51.0 Secondary Damage Cost covers the estimated material 
costs to other components due to the failure of the component 
being proposed for modification. 

52.0 Incidental Costs represent a collective element 


which accounts for any miscellaneous material costs per 
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unscheduled event that are not covered by any other input 
element. 

53.0 Number of Part Numbers is the total number of part 
numbers that will be required in inventory in support of the 
new modification. 

Although these definitions seem general in nature and 
somewhat redundant at times, according to Christian [Ref. 4], 
they allow the user to interpret the information to suit a 
particular situation and also allow for general pooRReerae 


costs that do not have a unique input element. 


E. THE RESULTS SUMMARY SECTION 

The model’s result summary section performs the final cost 
calculations and produces a summary which displays the cost 
and savings from implementing the engine change proposal. The 
costs and savings are broken down into eight categories which 
are: 

Production Engine Costs are taken directly from the input 
section and represents the difference in price between a new 
engine incorporating the modification and one not 
incorporating the modification. The production engine cost 
will only be a factor only if there are engines still in 
preduceion, 

Operational Engine Modification Costs are the total of Kate 
purchase costs plus the kit installation costs over the 


engine’s life cycle. If the kit costs replace any maintenance 
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costs then those maintenance costs (unscheduled, scheduled, 
and hardware scrapping costs) are subtracted from the engine 
modification costs. These engine modification costs account 
for the costs, or savings, which are expected to occur from 
implementing the modification. 

Follow-on Maintenance Material Costs are equal to the 
difference between the follow-on material costs for the 
proposed component and those for the current component over 
the remaining life cycle. Both expected scheduled and 
unscheduled maintenance actions are included. 

Follow-on Maintenance Labor Costs are equal to the 
difference between the follow-on maintenance labor costs for 
the proposed component and the current component over the 
remaining life cycle. Both scheduled and unscheduled 
Maintenance actions are included. 

Publication Costs are taken directly from the input 
section (element 6.0). 

Tooling/Support Equipment Costs are also taken directly 
from the input section(element 10.0), 

Part Number Costs account for the cost of introducing and 
Maintaining a new part number in the supply system as a 
consequence of the proposed component modification. 

Fuel Cost factors in any life cycle fuel consumption 


Savings or costs which are attributable to the ECP. 


AS) 


III. MODEL ANALYSIS 


A. INTRODUCTION 

Chapter II provided a brief description of the model and 
the input data required. This chapter will first discuss life 
cycle costing, general modeling concepts and areas of 
evaluation. Next, the GE CEA model will be analyzed in two of 


these evaluation areas. 


B. LIFE CYCLE COST 

All systems and equipment pass through four major phases 
between the time of their creation to the time of their 
disposal. Dhillon [Ref. 5:p. 87] states that the four major 
phases of the life cycle are: 

1. The Concept and Definition Phase - During the concept 
and definition phase a need for a product is established and 
the product’s basic characteristics are defined. This 
activity results in documentation which states the 
requirements and how they can be met. 

2 The Acquisition Phase - The activities of the 
acquisition phase are directed toward product aequtetetonsage 
installation, and toward planning for the eventual support of 


the system or equipment chosen during the first phase. 
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3. The Operation and Maintenance Phase - The operation 
and maintenance phase, sometimes called the in-service phase, 
focuses on the maintenance and support of the system or the 
equipment during the entire operational life. This phase 
ensures that the capability requirements previously stated 
have been met, and will continue to be met, within the cost 
restraints. 

4. The Disposal Phase - The disposal phase is the final 
phase and consolidates all tasks required to remove the system 
or equipment, plus all its required supporting material. 

DOD Manual 5000.2-M states that cost and operational 
effectiveness analyses are essential elements of the decision 
making process for all acquisition programs. Life cycle cost 
estimating is part of the procurement process. Its purpose 
is to consider the overall total costs associated with each 
alternative form of the product. The comparison of the life 
cycle costs of alternatives requires some sort of common 


analytical, conceptual, or heuristic model be used. 


C. LIFE CYCLE COST MODELS 

To understand the full impact that the life cycle cost of 
a system or piece of equipment exerts on an organization, a 
life cycle cost model must be utilized to identify all facets 
of any future acquisition. There are a wide variety of life 
cycle cost models available in published literature [Ref. 6:p. 


737-742]. They include both general and specific models. 


ey, 


There is no single life cycle cost model which has been 
accepted as a standard model within DOD. There could be 
several reasons for not having a standard model; e.g., nature 
of the problem, many different types of equipment, devices or 
systems, or the inclination of the user. Nevertheless, 
irrespective of the types of models used for life cycle cost 
analyses, they all must be visible, transparent, and effective 
in representing systems, subsystems, or devices [Ref. 7]. 
One may describe life cycle cost models as predictive in 
nature and characterized by an underlying stochastic process 
involving many parameters. Two important examples of such 
parameters are maintainability and reliability. In addition, 
costs and other parameters may not be independent variables 
[Ref. 8:p. 535-549]. 
1. Elements Associated with Life Cycle Cost Analysis 
According to Dhillon [Ref. 9:p. 33] a life cycle cost 
analysis includes several activities. Some of those are: 
A. Identifying cost drivers; 
B. Establishing an accounting breakdown structure; 
C. Developing for every component in the life cycle 
cost breakdown structure the cost estimating 
relationship; 
D. Defining an item or product’s life cycle; 
E. Defining activities that generate a product’s 


ownership costs; 
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Establishing constant dollar cost profiles; 
Performing sensitivity analyses; 

Determine cost and effect relationships; and 
Developing escalated and discounted life cycle 


costs. 


2. Areas for Evaluation of the Life Cycle Model 


All phases of the life cycle model have to be 


evaluated periodically to keep it current to meet the needs of 


the user. 


The model user should perform the evaluation task. 


There are several areas about which questions should be asked 


to determine adequacy of the life cycle costing model. Some 


of these areas are as follows [Ref. 10]: 
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Construction of the cost model; 

Identification of cost drivers; 

Accuracy of cost estimating data base; 

Soundness of cost estimating methods used; 
Validation of cost estimates by an independent 
appraisal; 

Management review of the top ten cost drivers for 
economy; 

Compatibility of reliability with the life cycle 
cost requirements; 

Adequate consideration of inflation and 
discounting factors; 


Performance of trade-off studies; 


abe, 


J. Coordination of the life cycle cost and design to 
cost work; 
K. Awareness of the buyer concerning top ten cost 
drivers; and 
L. Suggestions by the model user for reducing such 
costs. 
Since the cost drivers of the CEA model have never 
been studied, and the military places great emphasis on 
reliability when improving any component, the following 


sections will evaluate these two areas of the CEA model. 


D. COST DRIVERS 

Cost drivers in a life cycle cost model are the elements 
that dominate the costs in the model. When changed in 
magnitude,these cost drivers exert the largest percentage 
changes on the total life cycle cost. Each system or piece of 
equipment has unique cost drivers which depend on the system 
or piece of equipment being considered. For example, cost 
drivers may be the cost of spares, transportation costs, 
failure rates, or the costs of installation. 

To help begin the study of the cost drivers in the model, 
an example is useful. Appendix A contains an example provided 
by GE [Ref. 11] of an ECP life cycle cost comparison for 
discussions at users group meetings. It will be used for all 


evaluations in this thesis. 
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Each of the first 18 input elements (See Chapter II) in 
the example was doubled, one at a time, to determine what 
effect that particular element had on the expected life cycle 
costs of the example ECP. The baseline costs were for the 
First Opportunity Incorporation Style. They were derived from 
the original data, including input changes, that came with the 
CEA model. Their values are: Current Configuration $29144.3; 
Proposed Configuration $22052.9; Savings $7091.31. The 
results are shown in Table I. 

The Data column in the Table I illustrates both the 
original input data values provided in the GE example and the 
corresponding changes that were made to each data element for 
this study. The next three columns of the table show the life 
cycle costs as the current configuration costs, the proposed 
configuration costs, and the resulting savings or losses. The 
percent change column compares the change that each particular 
data element exerted caused in the proposed costs with the 
Original proposed cost that was used as the baseline cost. 
Those showing a minus sign reflect the percentage of the 


proposed costs below the baseline proposed costs. 


Pat 


TABLE I: COST DRIVER ANALYSIS 


Elem. $(000’s) | $(000,s) | $(000,s) | CHANGE 
pa.oo | 1 —__—Y 2944.30 | 27506.50| 1637.71 | 25 
| | 2pase i 2944.3 | 2052.9 | 7091.31 | 0 
pa 9244.30 | 28290.50| 953.73 | 28 
4.10 | 2-4  __—| 29144.30| 22090.40] 7053.80 | 00 | 
| 5.20 | 43.30-86.60 _| 29144.30| 23900.00| 6914.40 | 08 
| 6.00 | soo-1000 _| 29144.30 | 22053.40| 7090.81 | 00 _ 
| 7.00 | 1500-3000 _| 29144.30 | 22054.40| 7089.80 | 00 _ 
|a.oo | 1524-3048 _| 29144.30| 22059.00] 7085.20 | 00 _ 
| 9.00 | 250-500 _—| 29144.30| 22089.90| 7080.30 | 00 | 
}10.00 | 500-1000 _| 29144.30| 22053.40| 7090.80 | _00__ 
j13.00 | o-1 _——_—|_29144.30| 31818.40| -2674.10] 44 
[14.00 | 1991-1993 _| 29144.30| 24112.50| 5032.70 | 09 _ 


The results Or this evaluation identified the 
Incorporation Style (element 1.00), Kit Hardware Cost (element 
3.00), and the Spare Part Factor (element 13.00) as the 


principal cost drivers for this particular example. These 


ee 


drivers are highlighted in the table. The details associated 
with these cost drivers are explained below. 
1. Incorporation Style 

Incorporation Style (element 1.00) is the method by 
which the modification will be incorporated into the existing 
fleet. The methods include by Attrition, which is modifying 
a component only during a failure; First Opportunity, which is 
modifying during-any scheduled or unscheduled maintenance; or 
by Forced Retrofit, which allows for a specific modification 
rate to be set by the operator which is independent of any 
scheduled or unscheduled maintenance. 

Each incorporation style has its own unique costs 
which are derived by taking the number of engines entered in 
the attrition and forced removal columns of the standard 
history section of the model. These are then added to the 
number of kits installed at production, to give the total 
number of kits installed in the proposed configuration 
section. 

First Opportunity was the style originally used in the 
example, and according to Stephanie McDonald of U.S. Air Force 
ECP Department, this is the Incorporation Style used ninety- 
nine percent of the time necenae of its low cost and timing of 
the modification installation. Table I shows that Attrition 


and Forced Retrofit increased the life cycle cost of the ECP 
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by 25 and 28 percent respectively over the First Opportunity 
case which served as the baseline. 
2. Kit Hardware Cost 

Kit Hardware Cost (element 3.00) is the cost of all 
material and hardware required for an ECP modification. Table 
I shows that doubling this cost resulted in a 39 percent 
increase in the proposed ECP costs over those of the baseline. 
It also shows that there was no savings. 

The user must carefully consider the impact of this 
cost because its value may not be known with any certainty 
initially. An investigation into how much the kit cost could 
change before it is uneconomical to incorporate the 
modification should be made. In particular, in safety of 
flight issues, the user of the model may discover that the 
trade-off between safety and the kit cost could become 
enormous. Figure 1 illustrates how the Kit Hardware Cost 
affects the savings. 

As Figure 1 shows, the savings in life cycle costs are 
strictly a linear function of Kit Cost, decreasing as the cost 
of the kit increases. In this case, the modification will 
become uneconomical to install when the price per kit 
approaches $27,000 for the example data. The user of the 
model must be aware that since this is a linear function and 
a major cost driver, no matter what the reason is that an ECP 


should be incorporated, $27,000 is the maximum that kit 
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hardware cost can be while still showing a savings in this 


example. 


$5 
$4 
$3 


$2 


SAVINGS 
C Thousands) 


$1 
$0 
C$1) 


C$2) 
$20, 000 $22,000 $24, 000 $26,000 $29,000 


K!T COST 


Figure 1 


3. Spare Parts Factor 
The last cost driver that is highlighted in Table I is 
the Spare Part Factor (element 13.00). The Pratt and Whitney 
representative defines this as the "percentage of total 
installed engines" that are assumed to be spare engines or 
modules sitting on the shelf at a warehouse that need to have 
the ECP upgrade. Kits are also needed for these engines and 


modules. 


PAS, 


To evaluate the impact of this element, the author 
entered values for the spare parts factor ranging from 0.008 
to 0.9. The model calculates the number of kits expected to 
be installed on spare engines and modules/components (column 
CO in the example), by multiplying the spare parts factor by 
the number of kits installed for a given year (column CL) on 
engines in use plus the number of engines modified at 
production (column CC) for that year. How the spare parts 
factor affects the savings is represented in Figure 2 below. 

As Figure 2 indicates, the spare parts factor also 
reduces the savings but in a piece-wise linear fashion. A 
dramatic decrease in the savings from the spare parts factor 
occurs as the factor increases from 0.1 to 0.9. The reason 
for this piece-wise decrease in savings can be attributed to 
the rounding rule used to determine integer number of spares 
needed in any given year. In the example used, all fractional 
values were rounded down. 

It must be noted that this spare cost factor does not 
take into account the spare required if a component which has 


a kit already installed fails. 
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Figure 2 


4. Section Summary 

This section has examined the three major cost drivers 
For GE’s example. The highlighted percentages from Table I 
identified these costs drivers as the Incorporation Style, Kit 
Cost, and the Spare Parts Factor. All of these elements 
increased the proposed baseline cost from twenty-five to 
forty-four percent. Increases in the other data elements in 
the model did not exert anywhere near as much influence as the 


three previously mentioned. It also appears from this 


2h 


sensitivity analysis that no matter what example is used, 
these three elements can be expected to exert the greatest 


amount of influence on any life cycle cost calculations. 


E. RELIABILITY 

The second area of the CEA model to be evaluated was the 
reliability of the component requiring the ECP and what effect 
it has on the final life cycle cost. 

1. Introduction 

Reliability may be described as "quality in the time 
dimension". [{Ref. 12:p. 4] It is classically defined as the 
probability that an item will perform satisfactorily for a 
specified period of time under a stated set of use conditions. 
From a functional point of view, in order for an item to be 
reliable, it must do more than meet an initial factory 
performance or quality specification--it must also operate 
satisfactorily for an acceptable period of time in the field 
application for which it is intended. [Ref. 13:p. 9-1] 

The classical definition of reliability, stated above, 
stresses four elements, namely: probability, performance 
requirements, time and use conditions. Probability is that 
quantitative term which expresses the likelihood of an event’s 
occurrence (or non-occurrence) as a value between zero and 
one. Performance requirements are those criteria which clearly 
define or describe what is considered to be satisfactory 


operation. Time is the measure of that period over which one 
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can expect satisfactory performance. Use conditions are the 
environmental conditions under which one expects an item to 
function adequately. 

Determining reliability, therefore, involves’ the 
understanding of several concepts which relate to these four 
definitional elements. Among such concepts is that a failure 
rate can vary as a function of age. A failure rate is a 
measure of the number of malfunctions occurring per unit of 
time. In order to explain the variation in failure rate, 
separate consideration is typically given to three discrete 
periods when viewing the failure characteristics of a product 
or item over its life span (and then considering a large 
sample from its population). Anderson [Ref. 12] describes 
these periods as: 

a) Infant Mortality Period 

Initially, the item population exhibits a high 
failure rate. This failure rate decreases rapidly during 
this first period (often called the "infant mortality", 
"burn-in", or debugging period), and stabilizes at an 
approximate value when the weak units have died out. It 
may be caused by a number of things: gross built-in flaws 
due to faulty workmanship, transportation damage or 
installation errors. This initial failure rate is 
unusually pronounced in new equipment. 
b) Useful Life Period 

The item population, after having been burned-in, 

reaches its lowest failure rate level, which is normally 


characterized by a relatively constant failure rate, 
accompanied by negligible or very gradual changes due to 


wear. This second period is called the useful life 
period, and is characterized mainly by the occurrence of 
stress related failures. The exponential failure 


distribution is widely used as a mathematical model to 
approximate times between failure during this time period. 


29 


This period varies among hardware types, is the interval 
usually given most weight in design reliability action, 
and is the most significant period for reliability 
prediction and assessment activities. 
el) Wearout Period 

The third and final life period occurs when the item 
population reaches the point where the failure rate starts 
to increase noticeably. This point is identified as the 
end of useful life or the start of wearout. Beyond this 
point on the time axis, the failure rate increases 
rapidly. When the hardware failure rate becomes 
unacceptably high, replacement schedules (of critical 
short-life components) are based on the recognition of 
this failure rate. 

Optimizing reliability involves the consideration of 
all three of these life periods. Barly failures must be 
eliminated by systematic procedures of controlled screening 
and burn-in tests. Stress related failures must be minimized 
by providing design margin.  Wearout must be eliminated by 
timely preventative replacement of short-life component parts. 
Thus, all major factors which influence (and degrade) a 
system’s operational reliability must be addressed during 
design to optimize and control system reliability. [Ref. 
14: pee 

In order to introduce several additional concepts, the 
author will focus now on the useful life period. The CEA 
model considers only the useful life period. During this time 


period, reliability is described by means of the single 


parameter exponential distribution: 


R(t) =e74 


ane) 


R(t) ais the probability that the item will 
operate without failure for the time 
period, t (usually expressed in hours), 
under stated operating conditions; 


S is the base of the natural logarithms, 
equal Ge V2. 7102... gc. s 


rN is the item failure rate (usually expressed 
in failures per hour), and is a constant 
for any given set of stress, temperature, 
and quality level conditions. fess 
determined for parts and components from 
large scale data collection and/or test 
programs. 
When appropriate, the values of A and t are inserted into the 
above expression to obtain the probability of success (i.e., 
reliability) is obtained for that time period. 
As will be shown latter, the reciprocal of the failure 
rate is the mean time between failures (MTBF); i.e., 
MTBF = 1/dX. 
The MTBF is primarily a figure of merit by which one hardware 
item can be compared to another. 
2. Exponential Failure Model 
The exponential failure model can be derived from the 
basic notions of probability. [Ref. 13] When a fixed number, 
N,, Of components are repeatedly tested, there will be, after 
a time t, N, components which survive the test and N, 


components which fail. The reliability or probability of 


Survival, is at any time t during the test: 


Syl 





Since N, = N, - N;,, reliability can be written: 
N= Ni N 
R(t) 20 f£24-_4£2=]-F(t); 
N, oO 
and 
dR 1 AN; 
aca — ee ge | gs : 
Gl MeN Gc ue) 
where f(t) = the failure density function; i.e., the 
probability that a failure will occur in the next time 
increment, dt. 


The hazard rate z(t) 


is defined as the ratio of the 


fractional failure rate Co the fractional surviving quant lee 


[Ref. 15:p. 345] Analytically, z(t) 
Blas) = SAG) 
1-[£(u) du 


and,therefore, it can be shown that 


z(t) =A. 
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can be written as 


In general, it can be assumed that the hazard rate of 
components and systems remains constant over practical 
intervals of time; i.e., is independent of the accumulated 
life of a system up to that point in time. Thus, A represents 
the expected number of random failures per unit of operating 
time of a system or, in other words, the failure rate. When 


a constant failure rate is assumed: 


C 


R(t) =[1-F(u) ]du=e-*t 
0 


gives the function based on the exponential distribution 
function commonly used in reliability prediction. 

Also, the mean time to failure can be determined, when 
a constant failure rate is assumed, by: 


MTBF=[2 te tdt=— 


The above expressions for R(t) and MTBF are the basic 
mathematical relationships used in reliability prediction. 
The assumption of a constant failure rate for complex 
systems is judged applicable because of the many forces that 
can act independently upon the item and cause failure. As 
stated previously, the stress/strength relationship and 
varying environmental conditions effectively result in such 


trandgom"’ failures. 
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3. Reliability Analysis 

Before a reliability analysis on the CEA model can be 
conducted, it is necessary to first explain how failures are 
represented in the model. There are two types; the failures 
of the component being improved and the aggregate engine 
failure. For the first type, failure rates are provided by 
the contractor as element 22.0 in the input data. The units 
are given as failures per 1000 flight hours. The model then 
multiplies the total expected programmed engine flight hours 
per year by this failure rate and places this total in column 
BD, of the GE example, for the current configuration 
unscheduled maintenance, and column CH for the proposed 
configuration unscheduled maintenance. The values in these 
columns thus represent the expected number of failures of the 
component in each year. Similarly, the engine expected 
aggregate failure rate is entered as element 17.0. It, too, 
is multiplied by the total programmed flight hours to get 


aggregate engine failures per year. 


F. SIMULATION 

The CEA model is only an expected value cost model and 
thus does not consider the variability in life cycle cost and 
savings. An understanding of that variability can help 
decision makers make more careful decisions on ECP’s. 

This section describes a very simple simulation model 


which assumes the component is the only item failing based on 
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the exponential distribution. The purpose is to begin to 
understand the impact improved reliability has on life cycle 
cost. The component failure rates for the example were 0.02 
per 1000 hours and 0.002 per 1000 hours for the current and 
proposed configurations, respectively. 

Fifty system lifetime simulations, covering twenty years, 
were conducted and the component failures for each year were 
incorporated into the appropriate columns of the model. At 
the end of each simulation the Current Costs, Proposed Costs, 
and resulting Savings were recorded. The results of these 
fifty simulations are illustrated in Figure 3. 

The top curve represents the simulated life cycle costs 
for the current configuration of the component, the middle 
curve represents the simulated life cycle costs for the 
proposed configuration, and the lower curve represents the 
Savings from the ECP. For the proposed configurations the 
costs show very little variability throughout the simulations, 
ranging from $21,900 to $23,060. The current configuration 
showed much more variable costs, ranging from $27,500 to 
ae, OOO The savings ranged from $5000 to $8500. The 
variability of the life cycle costs is reduced as a 
consequence of having fenee failures per year due to a lower 


failure rate. 
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1. Section Summary 


This section of the chapter evaluated how component 
reliability affects the CEA model. First, reliability was 
defined and the change in failure rates over the life of a 
component were explained. Next, the exponential distribution 
model’s use in determining the failure rate of a component was 


discussed. Finally, a simulation analysis of the CEA model 
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using the GE example was performed. This resulted in the 
variability of the life cycle costs of a component being 


reduced as the reliability of that component was improved. 
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IV. SUMMARY, CONCLUSIONS AND RECOMMENDATIONS 


A. SUMMARY 

The main objective of this thesis was to determine if the 
CEA model actually reflects the life cycle costs for aircraft 
engine component improvements. A secondary consideration was 
to discover the cost drivers in the model by a sensitivity 
analysis. In addition, simulations were ran on an example 
provided by General Electric’s Aircraft Engines Division to 
determine how reliability improvement of a component affects 
the variability of the model’s life cycle cost calculations. 

To accomplish these objectives, the author first had to 
determine if the CEA model calculates true life cycle cost. 
Chapter II specifically discussed the format of the CEA Model 
which included the definition of all input elements. Chapter 
III addressed the four phases of a life cycle that are 
required for an effective life cycle cost model and presented 
some areas that should be evaluated to determine if the model 
is achieving the objective for which it was designed. Et 
became evident that the model does not calculate all of the 
life cycle costs, both before and after an ECP is installed on 
a component. It only considers those life cycle cost elements 


affected by the installation of the ECP. 
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A simple sensitivity analysis was then performed on the 
CEA model to determine which input elements were the cost 
drivers in the particular example provided by GE. Those found 
to be major drivers were then examined more carefully to 
determine how the savings were related to changes in their 
values. 

Finally, fifty simulations were conducted on the model to 
study the variability of the.life cycle cost savings as the 


reliability of a component is improved through a ECP. 


B. CONCLUSIONS 

The CEA Model does not incorporate all four phases of a 
component’s life cycle cost. As stated earlier, it only 
calculates the costs before and after an ECP is installed. 

The cost drivers for the GE example used with the CEA 
model were Incorporation Style, Kit Hardware Cost, and the 
Spare Parts Factor. Any ECP installed will require the input 
of the Incorporation Style and Kit Hardware Cost. Although 
the Spare Parts Factor proved to be a cost driver from the 
analysis, the true impact of its use in the model may be 
questionable. In all the examples provided by GE, 
illustrating various uses of the model, the Spare Parts Factor 
has always been zero. By the definition of this term , this 
means that there are no extra kits required because there are 
no spare engines or components that are on the shelf or ina 


warehouse that need modified. It is also important to note 
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that the Spare Parts Factor does not address the question of 
using the inventory of spare modified components to replace 
those which fail. In fact, the hardware costs to scrap 
suggest that unexpected failures will result in high future 
costs to replace any failed components since no more modified 
components are available as spares in the inventory. However, 
even if there are spare modified spare components on the 
Shelf, as Fert lectedmby a non-zero Spare Parts Factor, these 
are not used in the model to replace failed modified 
components. 

This CEA Model does provide the basic information needed 
for the Useful Life and Disposal Phase part of an effective 
life cycle cost model. This information alone is not enough 
for justifying the expense of an ECP. What is needed is a 
model which incorporates all four phases to provide the user 
with some idea what all the costs of any ECP entails. At, the 
last CEA Users Group meeting, on 28 April 1992, the Air Force 


asked that the development costs be added to the model. 


C. RECOMMENDATIONS 

It is recommended that further evaluations be conducted on 
the CEA Model. At this point in time, there are still too 
many questions regarding the details of formulas used in this 
model for calculating life cycle costs. The definitions of 
the input elements need to be more specifically defined to 


make them mean the same for all situations. The elements that 
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are redundant need to be removed and replaced with ones that 
can give more pertinent information about the ECP being 
contemplated. 

In addition, the model should be programmed ina different 
computer language. The Lotus 1-2-3 spreadsheet style 
currently in use is too long and makes it difficult to track 
how one input element affects the entire outcome. At the 
recent Users Group meeting the decision was made to convert to 
EXCEL because the Air Force has converted from LOTUS to EXCEL 
in the Aeronautical Systems Division. This probably will not 
help much with model understanding. Professor McMasters, at 
the Naval Postgraduate School, is developing a FORTRAN program 
for the purpose oof understanding the input/output 
interactions. 

Finally, there is a strong possibility that the CEA model 
will be the model required by all the military services to 
justify the funding of ECP’s but, until the Concept & Define 
and the Acquisition Phase costs are included in the model, no 
accurate trade offs can be made between these costs and the 


Savings in "useful life" costs expected from the ECP. 
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APPENDIX A 
COST EFFECTIVENESS ANALYSIS EXAMPLE 
Appendix A is an example component modification provided 


by the General Electric Aircraft Engines Corporation. 
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General Electric Aircraft Engines 


aoe COST EFFECTIVENESS ANALYSIS **** 


TITLE: GEAE Master With PW Sample Inputs 
ENGINE MODEL: F110-GE-CEA AIRCRAFT MODEL: 
TASK/ECP: Sample Model 


27-Apr-92 


F16 


This isa ee spreadsheet prepared by GE Aircraft Engines 


for the April 1992 CEA User’s Group. 
The ee parameters for this spreadsheet are the 

ones used 

25/26-Feb-1992. 


game as the 


n the spreadsheet during the USN Briefing on 


SUMMARY - Delta between current and proposed configurations. 
All values are shown as Fiscal Year 1991 (SELL PRICE). 


F16 
Cost Savings 
$ (000) § (000) 
Production Engine Cost $330.0 
Operational Engine Modification Cost $9,176.0 
Follow-on Maintenance Material Cost $15,305.1 
Follow-on Maintenance Labor Cost Se52..5 
Publications Cost S20 
Tooling & SE - Total cost 0S 
Part Number Cost $18.1 
Operational Fuel Cost 
Totals $9,526.6 S1l67:157.6 
Net Delta Dollar Impact $(000) 56,63 1)..0 
ASSUMPTIONS 
Incorporation in Production engines will begin: MAY 1991 
Number of engines Eo gucee with this change is 33 
Number of spare units incorporating this change is 0 
Modification of operational engines can Bee ie in AUG 1991 
Incorporation of this change in operationa 
engines will be accomplished by ---> lst Opportun. at O & I Level 
Total kits installed out of total 
engines not modified in production is STS tops 617 
Total engines lost to attrition is 59 
Total engines retired unmodified is 0 
Estimated yearly EFH in future 240 EFH per year 
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General Electric Aircraft Engines 


TITLE: GEAE Master With PW Sample Inputs 


ENGINE MODEL: F110-GE-CEA 
TASK/ECP: Sample Model 
RRARAKARAKRAAKARAAKKRAKR 
Incorporation style: 
1 = Attrition 

2 = let Opportunity 
3 = Forced 


(1,2, Ores) 


Does Kit Cost Replace Maint Cost? 
Pct of Sch Events Requiring Maint 
Delta Production Cost 
Kit hardware cost - $ per engine 
Kit labor manhours: 
4.1 O&! 
4.2 Depot 
Labor cost per manhour: 
5.1 2Ogr 
5.2 Depot 
Tech pubs cost - total § 
TCTO Cost - total § 
New P/N intro cost - S$/ P/N 
Annual P/N maint cost 
Tooling & SE - Total cost 
Test fuel - $/Gal 
Test fuel - Gal/Hr 
Spare parts factor 
Year field modification starts 
% Sch events being modified 
% Unsch events being modified 
Failure rate allowing modification 
Year production starts 
Engine Attrition Rate (Engs/EFH) 
Average EFH Per Eng Per Year 
Fiscal year dollars 
TAC/EFH Ratio 
TOT/EFH Ratio 


Unsch fail rate/1000 EFH 
Sch maint interval (TAC’s) 
Calculated rate/1000 EFH 
Sch MHrs to inspect, O level 
Sch % rmvd, O&I level 
MHrs to R/R, O level 
MHrs, I level 
% O&I req repair 
material cost O&I 
ret to Depot 
MHrs, Depot 
% Depot req repair 
material cost, Depot 
Sch % scrap 

Hardware cost to scrap 
Sch test time 


Unach MHrs to inspect, O level 
Unsch % rmvd O&I level 

Unsch MHrs to R/R, O level 

Unsch MHrs, I level 

Unsch % OGI req repair 

Unsch material cost, O&I 
Unsch % ret to Depot 

Unsch MHrs, Depot 

Unsch % Depot Req Repair 

Unsch material cost, Depot 
Unsch % scrap 

Hardware cost to scrap 
Unsch test time 
Secondary damage cost 
Incidental costs 
Number of P/N’s 
RMRARAARRAARAARARRKRARKRKHR 
Operational Fuel - $/Gal 
Operational Fuel - Gal/Hr 


OPTIONS 


AIRCRAFT MODEL: 


RERARRARAKRARAKRNRARAKRARRARARRRRER 


INPUT SHEET 


>> 2 
>>NO 
>> 0% 
>> $10,000 
‘e $15,000 
>> 2.00 
7 20.00 
>> S32532 
>> $43.30 
>> $500 
>> $1,500 
>> $1,524 
>> $250 
>> $500.00 
>> $0.61 
>> 150.00 
>> 0.000 
>> 1991 
>> 100% 
>> 100% 
>> 0.02 
>> 1991 
>> 0.00002 
>> 240 
>> 1991 
>> 3.00 
>> Peso 
CURRENT DESIGN 

>> 0.020000 
>> 3000 

1.000 
>> 0.0 
>> 100% 
>> 10.00 
>> 25.060 
>> 100% 
>> $500.00 
>> 100% 
>> 10.00 
>> 10% 
>> $25,000 
>> 5.00% 
>> $62,500.00 
>> 1.50 
>> O20 
>> 100% 
>> 10.00 
>> 25.00 
>> 100% 
>> $500 
>> 100% 
>> 10.00 
>> 2.50% 
>> $1,250 
>> 1.00% 
>> $62,500.00 
>> L250 
>> $100,000.00 
>> $0.00 
>> 

$0.61 

150.00 
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General Electric Aircraft Engines 


RRRARRARRARRARKRKRRKRKRKRARRRRRRR INTERIM CALCULATIONS RRRRARRKRRARKRKRKRKRKRKRKRAKKRKREK EK 
TITLE: GEAE Master With PW Sample Inputs 4/27/92 
ENGINE MODEL: F110-GE-CEA 
TASK/ECP: Sample Model 

CURRENT PROPOSED 
NAME /CONTENTS/FORMULA (BASED ON INPUT REGION) --------------------------- 
A OPERATIONAL FUEL COST PER HOUR 91-5 gies 

54.0 * 55.0 

<<< SCHEDULED COST PER EVENT >>> 


B O&I MANHOURS 35 35 
25.0 + 26.0 * (27.0 + 28.0) 

Cc O&I MATERIAL REPAIR COST 500 500 
29.0 * 30.0 

D DEPOT MAN HOURS 10 10 
a. * 32.0 

E DEPOT MATERIAL REPAIR COST 2500 200 
33.0 * 34.0 

F DEPOT SCRAP COST 3125 250 
35.0 * 36.0 

<<< UNSCHEDULED COST PER EVENT >>> 

G O&I MANHOURS 35 35 
38.0 + (39.0 * (40.0 + 41.0)) 

H O&I MATERIAL REPAIR COST 500 S00 
42.0 * 43.0 

J DEPOT MAN HOURS 10 10 
44.0 * 45.0 

K DEPOT MATERIAL REPAIR COST Sil. 25 Pats) 
46.0 * 47.0 

L DEPOT SCRAP COST 625 5 
48.0 * 49.0 

M = eae SECONDARY DAMAGE 100000 100000 
Si. a 

N a INCIDENTAL COST 0 0 
Biz « . 

P SCHEDULED TEST COST (MATERIAL COST/EVENT) 267.15 267.15 
37.0 * (A + 2 * 5.2) 

R TEST COST/UNSCHEDULED EVENT 267.15 267.15 


50.0 * (A + 2 * §.2) 
waeakxaxke ASD FACTORS FOR EVALUATION: USED IN REFERENCED COLUMNS *****#« 


<<< SCHEDULED EVENTS >>> CURRENT COLUMN PROPOSED COLUMN 

U O&I LABOR COST PER EVENT PS. 2 os 1131.2 DA, DE 
Bo* 5.1 

V DEPOT LABOR COST PER EVENT 433 BS 433 DA, DE 
D's 5.2 

W MATERIAL COST PER EVENT 6392.15. BT 1217.15 DB, DF 


C+ E+ F + P 
<<< UNSCHEDULED EVENTS >>> 


xX O&I LABOR COST PER EVENT 1131.2 BQ Lisi.2 Wct, De 
G * 5.1 

x DEPOT LABOR COST PER EVENT 433 BQ 433 CY, DC 
Jy a5 .2 

v4 MATERIAL COST PER EVENT 101423. BR 100774. CZ, DD 


H+ K+ Lb +M+N +R 
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